The journey to transparency, reproducibility, and replicability
نویسندگان
چکیده
منابع مشابه
Replicability and Reproducibility in Comparative Psychology
Psychology faces a replication crisis. The Reproducibility Project: Psychology sought to replicate the effects of 100 psychology studies. Though 97% of the original studies produced statistically significant results, only 36% of the replication studies did so (Open Science Collaboration, 2015). This inability to replicate previously published results, however, is not limited to psychology (Ioan...
متن کاملFrom Reproducibility Problems to Improvements: A journey
Reproducibility and repeatability are key properties of benchmarks. However, achieving reproducibility can be difficult. We faced this while applying the microbenchmark MooBench [5] to the resource monitoring framework SPASS-meter. In this paper, we discuss some interesting problems that occurred while trying to reproduce previous benchmarking results. In the process of reproduction, we extende...
متن کاملReplicability, Reproducibility, and Agent-based Simulation of Interventions
Secondary use of medical data and use of observational data for causal inference has been growing. Yet these data bring many challenges such as confounding due to unobserved variables and variation in medical processes across settings. Further, while methods exist to handle some of these problems, researchers lack ground truth to evaluate these methods. When a finding is not replicated across m...
متن کاملReproducibility and replicability of rodent phenotyping in preclinical studies
The scientific community is increasingly concerned with the proportion of published "discoveries" that are not replicated in subsequent studies. The field of rodent behavioral phenotyping was one of the first to raise this concern, and to relate it to other methodological issues: the complex interaction between genotype and environment; the definitions of behavioral constructs; and the use of l...
متن کاملEditorial: Code Case - Investigating Transparency and Reproducibility
Everyone from scientists, reviewers, to funding agencies and publishers, talks about the lack of reproducibility and transparency in present research. Many high-profile papers are based on highly specialized techniques that few have mastered, which make them very difficult to reproduce. Many laboratories have developed their own software to perform data analysis. These are rarely evaluated by r...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Journal of the American Medical Informatics Association
سال: 2019
ISSN: 1067-5027,1527-974X
DOI: 10.1093/jamia/ocz007